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In this work we present a model for computation of random processes in digital 
computers which solves the problem of periodic sequences and hidden errors pro- 
duced by correlations. We show that systems with non-invertible non-linearities can 
produce unpredictable sequences of independent random numbers. We illustrate our 
result with some numerical calculations related with random walks simulations. 

PACS numbers: 05.10.-a, 05.40.a, 05.40.Fb, 07.05.Tp 

Many challenging problems in computational physics are associated with reliable re- 
alizations of randomness (e.g Monte Carlo simulations). In a typical 32-bit format a 
maximum of 2^^ floating points numbers can be represented. Therefore, a recursive 
function Xn+i = /(-^n, -^n-i, • • • , -^n-r+i) acting on these numbers generates a sequence 
Xo,Xi,X2, ...,Xjv_i which must repeat itself. It is known that for any recursive function, a 
digital computer can only generate periodic sequences of numbers . These 

generators are not unpredictable. 

Definition of truly unpredictable: The next values are not determined by the previ- 
ous values. A process X„ = P{9TZ^) is said to be unpredictable if for any string of 
values Xo, Xi, X2, Xm of length m + 1, generated using some 9 = 9i, there are other 
values of 9 for which function X„ = P{9TZ"') generates exactly the same string of numbers 
Xo,Xi,X2, ...,Xm, but the next value X^+i is different, where m is any integer. Note that 
;his kind of process cannot be expressed as a map of type X„+i = /(X„, X„_i, . . . , X„_,.+i) 

All known generators (in some specific physical calculations) give rise to incorrect results 
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because they deviate from randomness 0,1^, |5|,l7|. It is trivial that any periodic process is 
not unpredictable. Suppose is the period of the generated sequence. Given any string of 
niT values: Xg, Xg+i, Xmrp-i', the next value X^j, is always known, because the process 
is periodic. On the other hand, for any generator of type X„+i = /(X„, X„_i, . . . , Xn~r+i), 
given any string of r values: Xs,Xs+i, ...,Xs+r-i] the next value Xg+r is always determined 
by the previous r values. Thus it is not unpredictable. So the subsequences must be 
correlated. 

An example of this can be found in Ref.^j, where the authors have shown that using 
common pseudo random number generators, the produced random walks present symme- 
tries, meaning that the generated numbers are not independent. On the other hand, the 
logarithmic plot of the mean distance < d > versus the number of steps N is not a straight 
line (as expected theoretically, < d >~ N^^^) after N > 10^ (in fact, it is a rapidly decaying 
function). Here d is defined as the end to end mean-square distance from the origin of the 
random walk as a function of the number of steps. Other papers on the influence of the 



pseudorandom number generator on random walk simulations are the following 

In the following, we will show that using non-invertible nonlinear functions, we can create 
an unpredictable random number generator which does not contain visible correlations while 



simulating a random walk with the length : 
Let us investigate the following function 
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where P{t) is a periodic function, is a real number, T is the period of the function P{t), 
and Z is a noninteger real number. 

Let Z he a rational number expressed as Z = p/q, where p and q are relative prime 
numbers. Now let us define the following family of sequences 
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where k, m and s are non-negative integers. The parameter k distinguishes the dif- 
ferent sequences. For all sequences parametrized by /c, the strings of m + 1 values 
Xs, Xs+i, ...,Xs^m are the same. This is so because 
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for all s < 72 < m + s. Note that the number k p*^" "■+^) is an integer for s < n < m + s. 

So we can have an infinite number of sequences that share the same string of m + 1 values. 

Nevertheless, the next value xi+'f"'^ = P T (f)' (f)^'^' ^ Tkp^ ig 
tain. In general X^^"^'^^ can take q different values. In addition, the value xl'^^'^\ 
^{k,m,s) _ p rp 0^ ^1 j ^£ j _l_ T kq<-^ + 'I ^ ^j^^ Undetermined from the values of the 

string Xg, Xg^i, Xs+2, ^s+m- There can be p different possible values. In the case of a 
generic irrational Z, there are infinite possibilities for the future and the past. From the 
observation of the string X^, X^^i, Xs^2, ^s+m, there is no method for determining the 
next and the previous values of the sequence. 

But this is not the only feature of these functions. It can be demonstrated that there 
are no statistical correlations between X^ and X„ if m 7^ ra, and that they are also inde- 
pendent in the sense that their probability densities satisfy the relationship P(X„,Xm) = 

p(x„)p(xj HQ. 

Moreover, we will show that, given the function (^, any string of sequences 
Xg, Xg+i, . . . , Xs+r constitutes a set of statistically independent random variables. 

Without loss of generality, we assume that P{t) has zero mean and can be expressed 
using the following Fourier representation P(t) = 0^.6^""^^ 

We can calculate the r-order correlation functions l4. Ilq: 

E(X„, ■■■X„J = [ d9P{T9Z''') ■ ■ ■ PiTeZ""^) 
Jx 

00 00 „x 

= ■ ■ ■ flfci ■ ■ ■ afc / exp {z7r(A;iZ"^ + ■ ■ ■ + /c,Z"'-)T^} 

/Cl = — 00 kr = — O0 

00 00 

= J2 Yl ak,---akAkiZ^' + --- + krZ''\0), (3) 

ki=—oo kr=—ca 

where the coefficients ki can be different integers, and 6{n,m) = 1 if n = m or 6{n,m) = 
if 7^ m. 

When all rij are even, the following equation is satisfied 

E(xr x,"f 1 ■ ■ ■ XX) = E{x:^)E{x:i,) ■ • ■ Eixx). (4) 

The main problem in this equation occurs when one of the numbers rij is odd. In this 
case, the correlations -E(X"^X"^]^ ■ ■ -X^^^^) must be zero. A nonzero correlation in Eq.Q 
exists only for the sets (ni,n2, . . . ,71^) that satisfy the equation kiZ"^ + ■ ■ ■ + k^Z""" = 0. 
For a typical real number Z, this equation is never satisfied. 
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If we use non-invertible nonlinear functions, type of (^J, we can implement a Truly Ran- 
dom Number Generator (TRNG). In this case, we propose the following function 

X„ = mod 1 (5) 

Function (jSj) is an example of the general case X„ = P[^TZ"] studied in this paper. 
We have shown that the subsequences Xs,Xs+i, . . . ,Xs+r constitutes a set of statistically 
independent random variables. The particular case of function (0) is well-known to produce 



uniformly distributed numbers P, ISl ll 
N 



ow we will formulate a central limit theorem. Using theorems proved in previous studies 
jl^ 15! Ilfil . IitI lis! Iioj l and the results obtained from this paper, we obtain the following 
formula: If Z is a generic real number and X„ = 2(y„ — 1/2), y„ = [6Z"']modl, then 



Xi+X2 + ---Xr ^1 1 



lim P <^ a < 111 < /3 k = ^ / de (6) 

The Gaussian distribution of the sums is correct even for other functions X„ = P[^^Z"], 



/3 



where P{t) is periodic. This has been shown in numerical simulations 



14 

m 



We can simu- 



The numbers X„ = [OZ'^^] mod 1 are uniformly distributed 
late different stochastic processes (with different distributions) using different functions 
X„ = P[eTZ'% As p(X„) = 1, p(X„+i) = 1, p(X„,X„+i) = 1, it is trivial that they 
are independent. 

It is interesting to check the theoretical predictions using numerical simulations of the 
behavior of different stochastic processes. 
For instance, let us study the function 

f/„ = cos[27r0Z"]. (7) 

All the moments and higher-order correlations can be calculated exactly jl^ lisj ] : 
For odd m: 

E{Un) = 0. (8) 

If any Ui is odd, then 

Eiu:^^u:i,---u:i,) = o (9) 

Suppose now that all rij are even: 
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EiUX) = 2-" 
Note that the condition for independence is satisfied 

Eiu:-u:i, ■ ■ ■ u:i,) = e{ut)e{u:},) ■ ■ ■ e{u:i 



(13) 



(14) 



for all integer no, ni, . . . n,,. 

We have performed extensive numerical simulations that confirm the values of these 
moments and the independent conditions. 

An additional checking is the following. 

The probability density of Un is p{U) = —ff^fW- Define Vn = Un+i- The probability 
density of Vn is piV) — ^ 
PiU,V) 



We have checked both theoretically and numerically that 



that is p{U, V) = p{U)p{y). This can be observed in Fig. 1 and 



7r2^(l-C/2)(l-V2) 

Fig. 2. In order to avoid computation problems, we have used the following procedure. We 




FIG. 1: Probability densities for random variables Un = cos[27r^Z"] and Vn = Un+i- a)p{U) 




FIG. 2: Probability density p{Un,Un+i), when C/„ = cos[2tt0Z'']. Here p{U,V) 



T'2^{l-U'2)il-V^) 



change parameter 6 after each set of M values of X„, where M is the maximum number for 
which there are not overflow problems, in such a way that the next value of Xn+i is obtained 
with the new 9. Let us define 



9s = A{Cs + Xs) + 0.1 (15) 

where Cs is a sequence obtained using the digits of the Champernowne's number (i.e., 
0.1234567891011...): Co = 0.123456 , Ci = 0.234567, C2 = 0.345678, C3 = 0.456789, 
C4 = 0.567891, and so on. This sequence is nonperiodic. Index s is the order number of 6 
in such a way that s = corresponds to the 6 used for the first set of M sequence values 
Xi, X2, Xm] s = 1 for the second set Xm+i, Xm+2, ■■■,X2m, and so on. Xq represents the 
TRNG's seed. 

Using this method we have generated a very long sequence of random numbers without 
computational problems. 

To test function (0) as a truly random number generator, we have implemented a random 
walk simulation program in C++. We have made a sampling test of a random walk with 
N = 10^ steps with 100 realizations with different initial seeds. The mean distance (d) was 
calculated every 1000 steps of the random walk. 

The Champernowne sequence of numbers used in the generator was produced previously 
by a short C++ program, who created a sequence of a maximum of 40000 Champernowne's 
numbers. If a larger amount of values to Cg is necessary, it can be obtained using a segment 
code that uses the 40 thousand values already stored in Cs and mixing them, e.g the algo- 
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rithm takes the first value of tlie series Ci, the third C3 and so on, and adds them at the 
end of the series, obtaining that C^+i = Ci, 6*^+2 = C3,...; if more values are necessary, this 
procedure or cycle is repeated but now skipping two values Ci, C3, C5,... three values Ci, 
C4, Cj and so on. In this way, we can make the Cg sequence as large as we wish. 

We present a logarithmic plot of the mean distance < d > versus the number of steps 
with = 10^ steps with A = 6.9109366 and Z = 7t/2 (See Fig. 3). We can verify that 
there is no deviation from the theoretical straight line, even for N » 10^ steps, which is a 
very good test of the reliability of the Random Number Generator used in the random walk 
simulations. 



(a) , (b) 




log(N) log (N) 



FIG. 3: Logarithmic plot of the mean distance < d > versus the number of steps N = 10^ steps, 
a) for generator ©, b) the same simulation for a generator of type Xn+i = aXn mod T. 

We have presented a random number generator based on the properties of non-invert ible 
transformations of truncated exponential functions. The obtained random process is unpre- 
dictable in the sense that the next values are not determined by the previous values. We 
have applied this generator to the numerical simulation of statistically independent random 
variables. In the simulation of a random walk with the length 10^, the random process does 
not contain visible correlations. 
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